Shared Responsibility Decreases the Sense of Agency in the Human Brain.

Sharing responsibility in social decision-making helps individuals use the flexibility of the collective context to benefit themselves by claiming credit for good outcomes or avoiding the blame for bad outcomes. Using magnetoencephalography, we examined the neuronal basis of the impact that social context has on this flexible sense of responsibility. Participants performed a gambling task in various social contexts and reported feeling less responsibility when playing as a member of a team. A reduced magnetoencephalography outcome processing effect was observed as a function of decreasing responsibility at 200 msec post outcome onset and was centered over parietal, central, and frontal brain regions. Before outcome revelation in socially made decisions, an attenuated motor preparation signature at 500 msec after stimulus onset was found. A boost in reported responsibility for positive outcomes in social contexts was associated with increased activity in regions related to social and reward processing. Together, these results show that sharing responsibility with others reduces agency, influencing pre-outcome motor preparation and post-outcome processing, and provides opportunities to flexibly claim credit for positive outcomes.

Sexually divergent development of depression-related brain networks during healthy human adolescence.

Sexual differences in human brain development could be relevant to sex differences in the incidence of depression during adolescence. We tested for sex differences in parameters of normative brain network development using fMRI data on N = 298 healthy adolescents, aged 14 to 26 years, each scanned one to three times. Sexually divergent development of functional connectivity was located in the default mode network, limbic cortex, and subcortical nuclei. Females had a more "disruptive" pattern of development, where weak functional connectivity at age 14 became stronger during adolescence. This fMRI-derived map of sexually divergent brain network development was robustly colocated with i prior loci of reward-related brain activation ii a map of functional dysconnectivity in major depressive disorder (MDD), and iii an adult brain gene transcriptional pattern enriched for genes on the X chromosome, neurodevelopmental genes, and risk genes for MDD. We found normative sexual divergence in adolescent development of a cortico-subcortical brain functional network that is relevant to depression.

Ergodicity-breaking reveals time optimal decision making in humans.

Ergodicity describes an equivalence between the expectation value and the time average of observables. Applied to human behaviour, ergodic theories of decision-making reveal how individuals should tolerate risk in different environments. To optimize wealth over time, agents should adapt their utility function according to the dynamical setting they face. Linear utility is optimal for additive dynamics, whereas logarithmic utility is optimal for multiplicative dynamics. Whether humans approximate time optimal behavior across different dynamics is unknown. Here we compare the effects of additive versus multiplicative gamble dynamics on risky choice. We show that utility functions are modulated by gamble dynamics in ways not explained by prevailing decision theories. Instead, as predicted by time optimality, risk aversion increases under multiplicative dynamics, distributing close to the values that maximize the time average growth of in-game wealth. We suggest that our findings motivate a need for explicitly grounding theories of decision-making on ergodic considerations.

Human complex exploration strategies are enriched by noradrenaline-modulated heuristics.

An exploration-exploitation trade-off, the arbitration between sampling a lesser-known against a known rich option, is thought to be solved using computationally demanding exploration algorithms. Given known limitations in human cognitive resources, we hypothesised the presence of additional cheaper strategies. We examined for such heuristics in choice behaviour where we show this involves a value-free random exploration, that ignores all prior knowledge, and a novelty exploration that targets novel options alone. In a double-blind, placebo-controlled drug study, assessing contributions of dopamine (400 mg amisulpride) and noradrenaline (40 mg propranolol), we show that value-free random exploration is attenuated under the influence of propranolol, but not under amisulpride. Our findings demonstrate that humans deploy distinct computationally cheap exploration strategies and that value-free random exploration is under noradrenergic control.

Learning in anticipation of reward and punishment: perspectives across the human lifespan.

Learning to act to receive reward and to withhold to avoid punishment has been found to be easier than learning the opposite contingencies in young adults. To what extent this type of behavioral adaptation might develop during childhood and adolescence and differ during aging remains unclear. We therefore tested 247 healthy individuals across the human life span (7-80 years) with an orthogonalized valenced go/no-go learning task. Computational modeling revealed that peak performance in young adults was attributable to greater sensitivity to both reward and punishment. However, in children and adolescents, we observed an increased bias toward action but not reward sensitivity. By contrast, reduced learning in midlife and older adults was accompanied by decreased reward sensitivity and especially punishment sensitivity along with an age-related increase in the Pavlovian bias. These findings reveal distinct motivation-dependent learning capabilities across the human life span, which cannot be probed using conventional go/reward no-go/punishment style paradigms that have important implications in lifelong education.

Fractionation of impulsive and compulsive trans-diagnostic phenotypes and their longitudinal associations.

OBJECTIVE: Young adulthood is a crucial neurodevelopmental period during which impulsive and compulsive problem behaviours commonly emerge. While traditionally considered diametrically opposed, impulsive and compulsive symptoms tend to co-occur. The objectives of this study were as follows: (a) to identify the optimal trans-diagnostic structural framework for measuring impulsive and compulsive problem behaviours, and (b) to use this optimal framework to identify common/distinct antecedents of these latent phenotypes. METHOD: In total, 654 young adults were recruited as part of the Neuroscience in Psychiatry Network, a population-based cohort in the United Kingdom. The optimal trans-diagnostic structural model capturing 33 types of impulsive and compulsive problem behaviours was identified. Baseline predictors of subsequent impulsive and compulsive trans-diagnostic phenotypes were characterised, along with cross-sectional associations, using partial least squares. RESULTS: Current problem behaviours were optimally explained by a bi-factor model, which yielded dissociable measures of impulsivity and compulsivity, as well as a general disinhibition factor. Impulsive problem behaviours were significantly explained by prior antisocial and impulsive personality traits, male gender, general distress, perceived dysfunctional parenting and teasing/arguments within friendships. Compulsive problem behaviours were significantly explained by prior compulsive traits and female gender. CONCLUSION: This study demonstrates that trans-diagnostic phenotypes of 33 impulsive and compulsive problem behaviours are identifiable in young adults, utilising a bi-factor model based on responses to a single questionnaire. Furthermore, these phenotypes have different antecedents. The findings yield a new framework for fractionating impulsivity and compulsivity, and suggest different early intervention targets to avert emergence of problem behaviours. This framework may be useful for future biological and clinical dissection of impulsivity and compulsivity.

Decreased value-sensitivity in schizophrenia.

Pathophysiology in schizophrenia has been linked to aberrant incentive salience, namely the dysfunctional processing of value linked to abnormal dopaminergic activity. In line with this, recent studies showed impaired learning of value in schizophrenia. However, how value is used to guide behaviour independently from learning, as in risky choice, has rarely been examined in this disorder. We studied value-guided choice under risk in patients with schizophrenia and in controls using a task requiring a choice between a certain monetary reward, varying trial-by-trial, and a gamble offering an equal probability of getting double this certain amount or nothing. We observed that patients compared to controls exhibited reduced sensitivity to values, implying that their choices failed to flexibly adapt to the specific values on offer. Moreover, the degree of this value sensitivity inversely correlated with aberrant salience experience, suggesting that the inability to tune choice to value may be a key element of aberrant salience in the illness. Our results help clarify the cognitive mechanisms underlying improper attribution of value in schizophrenia and may thus inform cognitive interventions aimed at reinstating value sensitivity in patients.

Emotional arousal and recognition memory are differentially reflected in pupil diameter responses during emotional memory for negative events in younger and older adults.

A better memory for negative emotional events is often attributed to a conjoint impact of increased arousal and noradrenergic modulation (NA). A decline in NA during aging is well documented but its impact on memory function during aging is unclear. Using pupil diameter (PD) as a proxy for NA, we examined age differences in memory for negative events in younger (18-30 years) and older (62-83 years) adults based on a segregation of early arousal to negative events, and later retrieval-related PD responses. In keeping with the hypothesis of reduced age-related NA influences, older adults showed attenuated induced PD responses to negative emotional events. The findings highlight a likely contribution of NA to negative emotional memory, mediated via arousal that may be compromised with aging.

Local but not long-range microstructural differences of the ventral temporal cortex in developmental prosopagnosia.

Individuals with developmental prosopagnosia (DP) experience face recognition impairments despite normal intellect and low-level vision and no history of brain damage. Prior studies using diffusion tensor imaging in small samples of subjects with DP (n=6 or n=8) offer conflicting views on the neurobiological bases for DP, with one suggesting white matter differences in two major long-range tracts running through the temporal cortex, and another suggesting white matter differences confined to fibers local to ventral temporal face-specific functional regions of interest (fROIs) in the fusiform gyrus. Here, we address these inconsistent findings using a comprehensive set of analyzes in a sample of DP subjects larger than both prior studies combined (n=16). While we found no microstructural differences in long-range tracts between DP and age-matched control participants, we found differences local to face-specific fROIs, and relationships between these microstructural measures with face recognition ability. We conclude that subtle differences in local rather than long-range tracts in the ventral temporal lobe are more likely associated with developmental prosopagnosia.

The human amygdala encodes value and space during decision making.

Valuable stimuli are invariably localized in space. While our knowledge regarding the neural networks supporting value assignment and comparisons is considerable, we lack a basic understanding of how the human brain integrates motivational and spatial information. The amygdala is a key structure for learning and maintaining the value of sensory stimuli and a recent non-human primate study provided initial evidence that it also acts to integrate value with spatial location, a question we address here in a human setting. We measured haemodynamic responses (fMRI) in amygdala while manipulating the value and spatial configuration of stimuli in a simple stimulus-reward task. Subjects responded significantly faster and showed greater amygdala activation when a reward was dependent on a spatial specific response, compared to when a reward required less spatial specificity. Supplemental analysis supported this spatial specificity by demonstrating that the pattern of amygdala activity varied based on whether subjects responded to a motivational target presented in the ipsilateral or contralateral visual space. Our data show that the human amygdala integrates information about space and value, an integration of likely importance for assigning cognitive resources towards highly valuable stimuli in our environment.

Goals and habits in the brain.

An enduring and richly elaborated dichotomy in cognitive neuroscience is that of reflective versus reflexive decision making and choice. Other literatures refer to the two ends of what is likely to be a spectrum with terms such as goal-directed versus habitual, model-based versus model-free or prospective versus retrospective. One of the most rigorous traditions of experimental work in the field started with studies in rodents and graduated via human versions and enrichments of those experiments to a current state in which new paradigms are probing and challenging the very heart of the distinction. We review four generations of work in this tradition and provide pointers to the forefront of the field's fifth generation.

Contextual interaction between novelty and reward processing within the mesolimbic system.

Medial temporal lobe (MTL) dependent long-term memory for novel events is modulated by a circuitry that also responds to reward and includes the ventral striatum, dopaminergic midbrain, and medial orbitofrontal cortex (mOFC). This common neural network may reflect a functional link between novelty and reward whereby novelty motivates exploration in the search for rewards; a link also termed novelty "exploration bonus." We used fMRI in a scene encoding paradigm to investigate the interaction between novelty and reward with a focus on neural signals akin to an exploration bonus. As expected, reward related long-term memory for the scenes (after 24 hours) strongly correlated with activity of MTL, ventral striatum, and substantia nigra/ventral tegmental area (SN/VTA). Furthermore, the hippocampus showed a main effect of novelty, the striatum showed a main effect of reward, and the mOFC signalled both novelty and reward. An interaction between novelty and reward akin to an exploration bonus was found in the hippocampus. These data suggest that MTL novelty signals are interpreted in terms of their reward-predicting properties in the mOFC, which biases striatal reward responses. The striatum together with the SN/VTA then regulates MTL-dependent long-term memory formation and contextual exploration bonus signals in the hippocampus.

Contextual novelty modulates the neural dynamics of reward anticipation.

We investigated how rapidly the reward-predicting properties of visual cues are signaled in the human brain and the extent these reward prediction signals are contextually modifiable. In a magnetoencephalography study, we presented participants with fractal visual cues that predicted monetary rewards with different probabilities. These cues were presented in the temporal context of a preceding novel or familiar image of a natural scene. Starting at ∼100 ms after cue onset, reward probability was signaled in the event-related fields (ERFs) over temporo-occipital sensors and in the power of theta (5-8 Hz) and beta (20-30 Hz) band oscillations over frontal sensors. While theta decreased with reward probability beta power showed the opposite effect. Thus, in humans anticipatory reward responses are generated rapidly, within 100 ms after the onset of reward-predicting cues, which is similar to the timing established in non-human primates. Contextual novelty enhanced the reward anticipation responses in both ERFs and in beta oscillations starting at ∼100 ms after cue onset. This very early context effect is compatible with a physiological model that invokes the mediation of a hippocampal-VTA loop according to which novelty modulates neural response properties within the reward circuitry. We conclude that the neural processing of cues that predict future rewards is temporally highly efficient and contextually modifiable.

Dopamine and effort-based decision making.

Motivational theories of choice focus on the influence of goal values and strength of reinforcement to explain behavior. By contrast relatively little is known concerning how the cost of an action, such as effort expended, contributes to a decision to act. Effort-based decision making addresses how we make an action choice based on an integration of action and goal values. Here we review behavioral and neurobiological data regarding the representation of effort as action cost, and how this impacts on decision making. Although organisms expend effort to obtain a desired reward there is a striking sensitivity to the amount of effort required, such that the net preference for an action decreases as effort cost increases. We discuss the contribution of the neurotransmitter dopamine (DA) toward overcoming response costs and in enhancing an animal's motivation toward effortful actions. We also consider the contribution of brain structures, including the basal ganglia and anterior cingulate cortex, in the internal generation of action involving a translation of reward expectation into effortful action.

Cooperation and heterogeneity of the autistic mind.

Individuals with autism spectrum conditions (ASCs) have a core difficulty in recursively inferring the intentions of others. The precise cognitive dysfunctions that determine the heterogeneity at the heart of this spectrum, however, remains unclear. Furthermore, it remains possible that impairment in social interaction is not a fundamental deficit but a reflection of deficits in distinct cognitive processes. To better understand heterogeneity within ASCs, we employed a game-theoretic approach to characterize unobservable computational processes implicit in social interactions. Using a social hunting game with autistic adults, we found that a selective difficulty representing the level of strategic sophistication of others, namely inferring others' mindreading strategy, specifically predicts symptom severity. In contrast, a reduced ability in iterative planning was predicted by overall intellectual level. Our findings provide the first quantitative approach that can reveal the underlying computational dysfunctions that generate the autistic "spectrum."

Modulatory effects of 5Hz rTMS over the primary somatosensory cortex in focal dystonia--an fMRI-TMS study.

Dystonia is associated with impaired somatosensory ability. The electrophysiological method of repetitive transcranial magnetic stimulation (rTMS) can be used for noninvasive stimulation of the human cortex and can alter cortical excitability and associated behavior. Among others, rTMS can alter/improve somatosensory discrimation abilities, as shown in healthy controls. We applied 5Hz-rTMS over the left primary somatosensory cortex (S1) in 5 patients with right-sided writer's dystonia and 5 controls. We studied rTMS effects on tactile discrimination accuracy and concomitant rTMS-induced changes in hemodynamic activity measured by functional magnetic resonance imaging (fMRI). Before rTMS, patients performed worse on the discrimination task than controls even though fMRI showed greater task-related activation bilaterally in the basal ganglia (BG). In controls, rTMS led to improved discrimination; fMRI revealed this was associated with increased activity of the stimulated S1, bilateral premotor cortex and BG. In dystonia patients, rTMS had no effect on discrimination; fMRI showed similar cortical effects to controls except for no effects in BG. Improved discrimination after rTMS in controls is linked to enhanced activation of S1 and BG. Failure of rTMS to increase BG activation in dystonia may be associated with the lack of effect on sensory discrimination in this group and may reflect impaired processing in BG-S1 connections. Alternatively, the increased BG activation seen in the baseline state without rTMS may reflect a compensatory strategy that saturates a BG contribution to this task.

Voxel-based morphometry reveals reduced grey matter volume in the temporal cortex of developmental prosopagnosics.

Individuals with developmental prosopagnosia exhibit severe and lasting difficulties in recognizing faces despite the absence of apparent brain abnormalities. We used voxel-based morphometry to investigate whether developmental prosopagnosics show subtle neuroanatomical differences from controls. An analysis based on segmentation of T1-weighted images from 17 developmental prosopagnosics and 18 matched controls revealed that they had reduced grey matter volume in the right anterior inferior temporal lobe and in the superior temporal sulcus/middle temporal gyrus bilaterally. In addition, a voxel-based morphometry analysis based on the segmentation of magnetization transfer parameter maps showed that developmental prosopagnosics also had reduced grey matter volume in the right middle fusiform gyrus and the inferior temporal gyrus. Multiple regression analyses relating three distinct behavioural component scores, derived from a principal component analysis, to grey matter volume revealed an association between a component related to facial identity and grey matter volume in the left superior temporal sulcus/middle temporal gyrus plus the right middle fusiform gyrus/inferior temporal gyrus. Grey matter volume in the lateral occipital cortex was associated with component scores related to object recognition tasks. Our results demonstrate that developmental prosopagnosics have reduced grey matter volume in several regions known to respond selectively to faces and provide new evidence that integrity of these areas relates to face recognition ability.

Game theory of mind.

This paper introduces a model of 'theory of mind', namely, how we represent the intentions and goals of others to optimise our mutual interactions. We draw on ideas from optimum control and game theory to provide a 'game theory of mind'. First, we consider the representations of goals in terms of value functions that are prescribed by utility or rewards. Critically, the joint value functions and ensuing behaviour are optimised recursively, under the assumption that I represent your value function, your representation of mine, your representation of my representation of yours, and so on ad infinitum. However, if we assume that the degree of recursion is bounded, then players need to estimate the opponent's degree of recursion (i.e., sophistication) to respond optimally. This induces a problem of inferring the opponent's sophistication, given behavioural exchanges. We show it is possible to deduce whether players make inferences about each other and quantify their sophistication on the basis of choices in sequential games. This rests on comparing generative models of choices with, and without, inference. Model comparison is demonstrated using simulated and real data from a 'stag-hunt'. Finally, we note that exactly the same sophisticated behaviour can be achieved by optimising the utility function itself (through prosocial utility), producing unsophisticated but apparently altruistic agents. This may be relevant ethologically in hierarchal game theory and coevolution.

Cholinesterase inhibition modulates visual and attentional brain responses in Alzheimer's disease and health.

Visuo-attentional deficits occur early in Alzheimer's disease (AD) and are considered more responsive to pro-cholinergic therapy than characteristic memory disturbances. We hypothesised that neural responses in AD during visuo-attentional processing would be impaired relative to controls, yet partially susceptible to improvement with the cholinesterase inhibitor physostigmine. We studied 16 mild AD patients and 17 age-matched healthy controls, using fMRI-scanning to enable within-subject placebo-controlled comparisons of effects of physostigmine on stimulus- and attention- related brain activations, plus between-group comparisons for these. Subjects viewed face or building stimuli while performing a shallow judgement (colour of image) or a deep judgement (young/old age of depicted face or building). Behaviourally, AD subjects performed slower than controls in both tasks, while physostigmine benefited the patients for the more demanding age-judgement task. Stimulus-selective (face minus building, and vice versa) BOLD signals in precuneus and posterior parahippocampal cortex were attenuated in patients relative to controls, but increased following physostigmine. By contrast, face-selective responses in fusiform cortex were not impaired in AD and showed decreases following physostigmine for both groups. Task-dependent responses in right parietal and prefrontal cortices were diminished in AD but improved following physostigmine. A similar pattern of group and treatment effects was observed in two extrastriate cortical regions that showed physostigmine-induced enhancement of stimulus-selectivity for the deep versus shallow task. Finally, for the healthy group, physostigmine decreased stimulus and task-dependent effects, partly due to an exaggeration of selectivity during the shallow relative to deep task. The differences in brain activations between groups and treatments were not attributable merely to performance (reaction time) differences. Our results demonstrate that physostigmine can improve both stimulus- and attention-dependent responses in functionally affected extrastriate and frontoparietal regions in AD, while perturbing the normal pattern of responses in many of the same regions in healthy controls.

How the brain translates money into force: a neuroimaging study of subliminal motivation.

Unconscious motivation in humans is often inferred but rarely demonstrated empirically. We imaged motivational processes, implemented in a paradigm that varied the amount and reportability of monetary rewards for which subjects exerted physical effort. We show that, even when subjects cannot report how much money is at stake, they nevertheless deploy more force for higher amounts. Such a motivational effect is underpinned by engagement of a specific basal forebrain region. Our findings thus reveal this region as a key node in brain circuitry that enables expected rewards to energize behavior, without the need for the subjects;awareness.